Confound-leakage: confound removal in machine learning leads to leakage

BACKGROUND: Machine learning (ML) approaches are a crucial component of modern data analysis in many fields, including epidemiology and medicine. Nonlinear ML methods often achieve accurate predictions, for instance, in personalized medicine, as they are capable of modeling complex relationships between features and the target. Problematically, ML models and their predictions can be biased by confounding information present in the features. To remove this spurious signal, researchers often employ featurewise linear confound regression (CR). While this is considered a standard approach for dealing with confounding, possible pitfalls of using CR in ML pipelines are not fully understood. RESULTS: We provide new evidence that, contrary to general expectations, linear confound regression can increase the risk of confounding when combined with nonlinear ML approaches. Using a simple framework that uses the target as a confound, we show that information leaked via CR can increase null or moderate effects to near-perfect prediction. By shuffling the features, we provide evidence that this increase is indeed due to confound-leakage and not due to revealing of information. We then demonstrate the danger of confound-leakage in a real-world clinical application where the accuracy of predicting attention-deficit/hyperactivity disorder is overestimated using speech-derived features when using depression as a confound. CONCLUSIONS: Mishandling or even amplifying confounding effects when building ML models due to confound-leakage, as shown, can lead to untrustworthy, biased, and unfair predictions. Our expose of the confound-leakage pitfall and provided guidelines for dealing with it can help create more robust and trustworthy ML models

The BrainMap strategy for standardization, sharing, and meta-analysis of neuroimaging data

<p>Abstract</p> <p>Background</p> <p>Neuroimaging researchers have developed rigorous community data and metadata standards that encourage meta-analysis as a method for establishing robust and meaningful convergence of knowledge of human brain structure and function. Capitalizing on these standards, the BrainMap project offers databases, software applications, and other associated tools for supporting and promoting quantitative coordinate-based meta-analysis of the structural and functional neuroimaging literature.</p> <p>Findings</p> <p>In this report, we describe recent technical updates to the project and provide an educational description for performing meta-analyses in the BrainMap environment.</p> <p>Conclusions</p> <p>The BrainMap project will continue to evolve in response to the meta-analytic needs of biomedical researchers in the structural and functional neuroimaging communities. Future work on the BrainMap project regarding software and hardware advances are also discussed.</p

Decision Models and Technology Can Help Psychiatry Develop Biomarkers

Why is psychiatry unable to define clinically useful biomarkers? We explore this question from the vantage of data and decision science and consider biomarkers as a form of phenotypic data that resolves a well-defined clinical decision. We introduce a framework that systematizes different forms of phenotypic data and further introduce the concept of decision model to describe the strategies a clinician uses to seek out, combine, and act on clinical data. Though many medical specialties rely on quantitative clinical data and operationalized decision models, we observe that, in psychiatry, clinical data are gathered and used in idiosyncratic decision models that exist solely in the clinician's mind and therefore are outside empirical evaluation. This, we argue, is a fundamental reason why psychiatry is unable to define clinically useful biomarkers: because psychiatry does not currently quantify clinical data, decision models cannot be operationalized and, in the absence of an operationalized decision model, it is impossible to define how a biomarker might be of use. Here, psychiatry might benefit from digital technologies that have recently emerged specifically to quantify clinically relevant facets of human behavior. We propose that digital tools might help psychiatry in two ways: first, by quantifying data already present in the standard clinical interaction and by allowing decision models to be operationalized and evaluated; second, by testing whether new forms of data might have value within an operationalized decision model. We reference successes from other medical specialties to illustrate how quantitative data and operationalized decision models improve patient care

Brain Circuitries Involved in Semantic Interference by Demands of Emotional and Non-Emotional Distractors

BACKGROUND: Previous studies have indicated that the processes leading to the resolution of emotional and non-emotional interference conflicts are unrelated, involving separate networks. It is also known that conflict resolution itself suggests a considerable overlap of the networks. Our study is an attempt to examine how these findings may be related. METHODOLOGY/PRINCIPAL FINDINGS: We used functional magnetic resonance imaging (fMRI) to study neural responses of 24 healthy subjects to emotional and non-emotional conflict paradigms involving the presentation of congruent and incongruent word-face pairs based on semantic incompatibility between targets and distractors. In the emotional task, the behavioral interference conflict was greater (compared to the non-emotional task) and was paralleled by involvement of the extrastriate visual and posterodorsal medial frontal cortices. In both tasks, we also observed a common network including the dorsal anterior cingulate, the supplemental motor area, the anterior insula and the inferior prefrontal cortex, indicating that these brain structures are markers of experienced conflict. However, the emotional task involved conflict-triggered networks to a considerably higher degree. CONCLUSIONS/SIGNIFICANCE: Our findings indicate that responses to emotional and non-emotional distractors involve the same systems, which are capable of flexible adjustments based on conflict demands. The function of systems related to conflict resolution is likely to be adjusted on the basis of an evaluation process that primarily involves the extrastriate visual cortex, with target playing a significant role

Subliminal versus supraliminal stimuli activate neural responses in anterior cingulate cortex, fusiform gyrus and insula:a meta-analysis of fMRI studies

Background: Non-conscious neural activation may underlie various psychological functions in health and disorder. However, the neural substrates of non-conscious processing have not been entirely elucidated. Examining the differential effects of arousing stimuli that are consciously, versus unconsciously perceived will improve our knowledge of neural circuitry involved in non-conscious perception. Here we conduct preliminary analyses of neural activation in studies that have used both subliminal and supraliminal presentation of the same stimulus. Methods: We use Activation Likelihood Estimation (ALE) to examine functional Magnetic Resonance Imaging (fMRI) studies that uniquely present the same stimuli subliminally and supraliminally to healthy participants during functional magnetic resonance imaging (fMRI). We included a total of 193 foci from 9 studies representing subliminal stimulation and 315 foci from 10 studies representing supraliminal stimulation. Results: The anterior cingulate cortex is significantly activated during both subliminal and supraliminal stimulus presentation. Subliminal stimuli are linked to significantly increased activation in the right fusiform gyrus and right insula. Supraliminal stimuli show significantly increased activation in the left rostral anterior cingulate. Conclusions: Non-conscious processing of arousing stimuli may involve primary visual areas and may also recruit the insula, a brain area involved in eventual interoceptive awareness. The anterior cingulate is perhaps a key brain region for the integration of conscious and non-conscious processing. These preliminary data provide candidate brain regions for further study in to the neural correlates of conscious experience

The Human Operculo-Insular Cortex Is Pain-Preferentially but Not Pain-Exclusively Activated by Trigeminal and Olfactory Stimuli

Increasing evidence about the central nervous representation of pain in the brain suggests that the operculo-insular cortex is a crucial part of the pain matrix. The pain-specificity of a brain region may be tested by administering nociceptive stimuli while controlling for unspecific activations by administering non-nociceptive stimuli. We applied this paradigm to nasal chemosensation, delivering trigeminal or olfactory stimuli, to verify the pain-specificity of the operculo-insular cortex. In detail, brain activations due to intranasal stimulation induced by non-nociceptive olfactory stimuli of hydrogen sulfide (5 ppm) or vanillin (0.8 ppm) were used to mask brain activations due to somatosensory, clearly nociceptive trigeminal stimulations with gaseous carbon dioxide (75% v/v). Functional magnetic resonance (fMRI) images were recorded from 12 healthy volunteers in a 3T head scanner during stimulus administration using an event-related design. We found that significantly more activations following nociceptive than non-nociceptive stimuli were localized bilaterally in two restricted clusters in the brain containing the primary and secondary somatosensory areas and the insular cortices consistent with the operculo-insular cortex. However, these activations completely disappeared when eliminating activations associated with the administration of olfactory stimuli, which were small but measurable. While the present experiments verify that the operculo-insular cortex plays a role in the processing of nociceptive input, they also show that it is not a pain-exclusive brain region and allow, in the experimental context, for the interpretation that the operculo-insular cortex splay a major role in the detection of and responding to salient events, whether or not these events are nociceptive or painful

Atypical Balance between Occipital and Fronto-Parietal Activation for Visual Shape Extraction in Dyslexia

Reading requires the extraction of letter shapes from a complex background of text, and an impairment in visual shape extraction would cause difficulty in reading. To investigate the neural mechanisms of visual shape extraction in dyslexia, we used functional magnetic resonance imaging (fMRI) to examine brain activation while adults with or without dyslexia responded to the change of an arrow’s direction in a complex, relative to a simple, visual background. In comparison to adults with typical reading ability, adults with dyslexia exhibited opposite patterns of atypical activation: decreased activation in occipital visual areas associated with visual perception, and increased activation in frontal and parietal regions associated with visual attention. These findings indicate that dyslexia involves atypical brain organization for fundamental processes of visual shape extraction even when reading is not involved. Overengagement in higher-order association cortices, required to compensate for underengagment in lower-order visual cortices, may result in competition for top-down attentional resources helpful for fluent reading.Ellison Medical FoundationMartin Richmond Memorial FundNational Institutes of Health (U.S.). (Grant UL1RR025758)National Institutes of Health (U.S.). (Grant F32EY014750-01)MIT Class of 1976 (Funds for Dyslexia Research

Adaptation of cortical activity to sustained pressure stimulation on the fingertip

Background Tactile adaptation is a phenomenon of the sensory system that results in temporal desensitization after an exposure to sustained or repetitive tactile stimuli. Previous studies reported psychophysical and physiological adaptation where perceived intensity and mechanoreceptive afferent signals exponentially decreased during tactile adaptation. Along with these studies, we hypothesized that somatosensory cortical activity in the human brain also exponentially decreased during tactile adaptation. The present neuroimaging study specifically investigated temporal changes in the human cortical responses to sustained pressure stimuli mediated by slow-adapting type I afferents. Methods We applied pressure stimulation for up to 15 s to the right index fingertip in 21 healthy participants and acquired functional magnetic resonance imaging (fMRI) data using a 3T MRI system. We analyzed cortical responses in terms of the degrees of cortical activation and inter-regional connectivity during sustained pressure stimulation. Results Our results revealed that the degrees of activation in the contralateral primary and secondary somatosensory cortices exponentially decreased over time and that intra- and inter-hemispheric inter-regional functional connectivity over the regions associated with tactile perception also linearly decreased or increased over time, during pressure stimulation. Conclusion These results indicate that cortical activity dynamically adapts to sustained pressure stimulation mediated by SA-I afferents, involving changes in the degrees of activation on the cortical regions for tactile perception as well as in inter-regional functional connectivity among them. We speculate that these adaptive cortical activity may represent an efficient cortical processing of tactile information.open

Multivoxel Pattern Analysis Reveals Auditory Motion Information in MT+ of Both Congenitally Blind and Sighted Individuals

Cross-modal plasticity refers to the recruitment of cortical regions involved in the processing of one modality (e.g. vision) for processing other modalities (e.g. audition). The principles determining how and where cross-modal plasticity occurs remain poorly understood. Here, we investigate these principles by testing responses to auditory motion in visual motion area MT+ of congenitally blind and sighted individuals. Replicating previous reports, we find that MT+ as a whole shows a strong and selective responses to auditory motion in congenitally blind but not sighted individuals, suggesting that the emergence of this univariate response depends on experience. Importantly, however, multivoxel pattern analyses showed that MT+ contained information about different auditory motion conditions in both blind and sighted individuals. These results were specific to MT+ and not found in early visual cortex. Basic sensitivity to auditory motion in MT+ is thus experience-independent, which may be a basis for the region's strong cross-modal recruitment in congenital blindness